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INTRDDUCTIQN 


Each  S/HMD  demonstration  began  operation  during  the  first  quarter  of  1985 
and  will  operate  for  66  months  under  the  current  waiver  authorization   The 
evaluation  began  in  October  1985  and  continues  through  November  1989   This 
chapter  covers  the  first  24  months  of  the  evaluation  plan.  Activities 
undertaken  during  the  evaluation  planning  phase,  October  1985  throuqh  Mav 
1986,  included  visiting  each  of  the  demonstration  sites  to  review^agement 
information  systems  and  become  acquainted  with  personnel  and  organizational 
structure;  reviewing  demonstration  protocols,  quarterly  reports,  and  other 
documents  to  become  fully  acquainted  with  the  planned  and  current  operations 
of  the  demonstratians;  corresponding  with  each  site  regarding  enrollment 
procedures;  assessing  site  experiences  with  the  Health  Status  Form  (HSF)  and 
the  Comprehensive  Assessment  Form  (CAF) ;  and  pre-testing  data  collection 
instruments. 

During  the  evaluation  of  the  first  operational  year,  June  1986  to 
September  1987,  all  major  planned  activities  were  completed.  These  included 
developing  comparison  group  samples  for  fee-for-service  (FFS)  beneficiaries 
and  HMO  enrollees;  conducting  health  status  interviews  and  in-home  assessments 
with  comparison  group  samples;  selecting  a  S/HMD  member  sample;  conductinq 
consumer  choice  interviews  with  S/HMD,  FFS,  and  HMO  enrollees;  conducting 
in-home  assessments  with  moderately  impaired  S/HMD  members;  tracking  quarterly 
the  out-of-pocket  expenditures  of  impaired  S/HMD  enrollees  and  FFS  ' 
beneficiaries;  surveying  HMD  disenrollees;  conducting  three  case  study  site 
visits  to  each  demonstration  market  area;  and  developing  an  integrated  health 
status  and  Medicare  claims  data  file. 

Four  factors  have  necessitated  adjustments  to  the  proposed  study  design- 
a  slower  than  expected  rate  of  S/HMD  enrollments;  lower  than  expected  S/HMD 
enrollment  of  Medicaid  eligible  persons;  identification  of  important 
differences  among  the  sites  in  their  procedures  for  screening  and  classifying 
enrollees  into  severely  impaired  and  unimpaired  groups;  and  the  rapid  growth 
of  enrollment  of  Medicare  beneficiaries  in  Medicare  risk  contract  HMDs 
arguing  for  HMD-S/HMD  comparisons,  where  feasible. 

To  address  these  issues,  the  evaluation  design  was  modified  to: 

Expand  the  study  sample  to  include  both  severely  and  moderately  impaired 
persons; 

Expand  the  impaired  and  unimpaired  fee-for-service  comparison  group  to 
better  examine  changes  in  health  status,  mortality,  and  Medicaid 
spend-down; 

Develop  an  HMD  comparison  sample  and  incorporate  data  collected  from  HMD 
enrollees  into  an  analysis  of  selection  bias,  consumer  choice,  and 
satisfaction ; 
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o 


o    Convert  the  consumer  choice  survey  from  a  mail  questionnaire  to  a  telephone 
interview. 

The  study  dropped  a  proposed  analysis  of  service  use  and  consumer  choice 
by  persons  eligible  for  Medicaid  at  the  time  of  S/HMO  enrollment.   Ihe  number 
of  persons  among  S/HMD  enrollees  and  the  fee-for-service  comparison  group  who 
spend  down  to  Medicaid  eligibility  will  continue  to  be  studied. 

Ihe  analysis  of  informal  caregivers  was  also  modified.  Information  on 
informal  caregivers  is  obtained  directly  from  the  impaired  beneficiaries  and 
family  members  rather  than  through  a  proposed  separate  survey  of  informal, 
caregivers. 

IMPACT  OF  S/HMO  ENROLLMENT  ON  SAMPLE  DESIGN 

Figure  1  lists  the  sample  and  study  areas  of  the  evaluation  experimental 
and  comparison  groups.  Sample  development  and  data  collection  plans  were 
influenced  by  S/HMO  enrollment  levels  and  the  prevalence  of  enrollee 
impairment.  In  the  original  demonstration  design,  each  S/HMO  site  planned  to 
enroll  at  least  4000  persons,  including  a  severely  impaired  population 
estimated  at  approximately  200  nursing  home  certifiable  (NHC)  cases  at  the 
time  of  enrollment.  The  number  of  severely  impaired  (i.e. ,  NHC)  persons  at 
enrollment,  plus  any  person  who  became  NHC  after  enrollment,  established  the 
maximum  sample  size  of  severely  impaired  persons  in  the  experimental  group. 
Thus,  in  the  original  demonstration  and  evaluation  design,  a  total  population 
of  800  NHC  persons  at  enrollment  and  perhaps  another  400  who  would  become  NHC 
sometime  during  the  24-month  period  after  enrollment  was  expected. 

With  the  exception  of  Kaiser  Medicare  Plus  II,  the  sites  have  had  slower 
enrollment  than  projected.  Total  enrollment  among  all  sites  on  June  1,  1986 
was  about  8,600,  or  about  half  the  planned  level.  Similarly,  the  number  of 
NHC  persons  was  half  the  number  expected. 

In  response  to  these  circumstances,  the  evaluator  took  three  steps  to 
expand  the  impaired  group  sample  size  and  maintain  statistical  power  for  the 
evaluation: 

o   Primary  data  collection  was  delayed  three  months  to  allow  the  sites  more 
time  to  build  enrollments. 

o   S/HMO  enrollments  through  June  1,  1986  were  included  in  the  sample  frame 
for  Portland  and  Long  Beach  and  enrollments  through  December  31,  1986 
were  included  in  the  S/HMO  sample  for  Brooklyn  and  Minneapolis. 

o   The  study  design  was  modified  to  broaden  and  standardize  the  definition 
of  impairment.  This  modification  to  the  evaluation  design  created  a 
common  impairment  classification  more  broadly  inclusive  of  persons  with 
functional  impairments  than  are  NHC  criteria.  This  standardized 
classification  approach  is  consistent  with  impairment  criteria  used  in 
other  recent  national  studies  of  the  aged  (e.g.,  the  1982  National  Long 
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Figure  1 
EXPERIMENTAL  AND  COMPARISON  GROUP  SAMPLES  AND  STUDY  AREAS 

S/HMO  Lnpaired  and  Unimpaired 
Enrollee  Experimental  Sample 

o    Health  status  at  baseline  and  selection  bias 
o    Health  status  changes  over  time 
o    Health  care  expenditures  and  utilization 
o    24  months  prior  to  enrollment 
24  months  after  enrollment 


o 
o 
o 
o 


Health  plan  choice  (all  impaired,  subsample  of  unimpaired) 
Health  plan  satisfaction  (all  impaired,  subsample  of  unimpaired) 
Informal  caregiving  (impaired  group  only) 

SS^vS)5^67  (al1  PerS°nS  disenrolli^  fra*  S/HMOs  between  6/1/86 


Impaired  and  Unimpaired  Fee-for-Service 
Medicare  Beneficiary  Comparison  Group 

o    Health  status  at  baseline  and  selection  bias 

o    Health  status  changes  over  time 

o    Health  care  expenditures  and  utilization 

24  months  prior  to  selection 

24  months  after  selection 


o 
o 


Health  plan  choice  (all  impaired,  subsample  of  unimpaired) 
Health  plan  satisfaction  (all  impaired,  subsample  of  unimpaired) 


o    Informal  caregiving  (impaired  only) 

Impaired  and  Unimpaired  Medicare  Enrollees 
in  RisJc-Contract  HMO  Comparison  Group 

o    Health  status  at  baseline  and  selection  bias 
o    Health  care  expenditures  and  utilization 

24  months  prior  to  enrollment  (all  impaired,  subsample  of  unimpaired) 

Health  plan  choice  (all  impaired,  subsample  of  unimpaired) 
Health  plan  satisfaction  (all  impaired,  subsample  of  unimpaired) 
Health  plan  disenrollees  (a  sample  of  risk-contract  HMO  disenrollees 
between  6/1/86  and  9/31/87) 


o 
o 
o 
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Term  tore  Survey) .  Without  such  modifications  the  study  would  have  been 
restricted  in  its  ability  to  pool  functionally  impaSd  caSs  ac^s 
S^JSK?!!!!  Seneralizability  to  functionally  impaired  populations 
would  have  been  compromised.  Standardized  criteria  arTshown^FigurTz . 

In  addition  to  nursing  home  certifiable  persons,  the  evaluation 
^airment  definition  added  two  important  subgroups:   (1)  persons  who  are 
severely  impaired  but  not  nursing  home  certifiaSTand  (2)^deratel?  impaired 
persons.  Inclusion  of  both  severely  and  moderately  impaired^SSs7^ 
ej^erimental  and  comparison  group  samples  expanded  the  ability!*  the  study  to 
SSLf^^J  Papulation  with  a  potential  for  high  transition  rate? 
between  impaired  and  unimpaired  status. 


PRIMARY  DATA  OOUECTIOW 


Primary  data  collection  consists  of  seven  tasks:  (l)  telephone 
case-finding  survey  to  construct  a  longitudinal  FFS  and  HMO  ccmparison  grouo 
£S  iS71^dU   (2)-  ^  ****io™^  (i.e.,  Health  StatS^orT^K^?^ 

Assessment  ^CSfT1Hgr^J,emberS  (angoht3)  '*  (3)  baselil,e  COtprehensive 
Assessment  Form  (CAF)  m-home  interview  and  periodic  CAF  trackingwith  frail 

S/HMD  and  FFS  panel  members  (ongoing);  (4)  consumer  choice  tele^^SJLw 

^S5JfBd/S,d  ^T^  S/HMD'  "■•  **  «°  «*Parison  grS^embe^ 
^•^!L(^LOU^°f"pOCket  health  care  expenses  and  serviced  tracking 
with  impaired  FFS  and  S/HMO  panels  (ongoing);  (6)  case  studies  of  the  SAM? 
case  management,  organizational  development,  and  market  environments 
(ongoing) ;  and  (7)  a  planned  mail  satisfaction  survey  to  S/HMO,  FFS.  and  HMD 
comparison  group  members.  ' 

TELEPHONE  CASE-FINDING  SURVEY 

in^-iS  ^ase-fi^ding  survey  had  two  purposes:   (a)  to  identify  functionally 
unpaired  fee-for-service  beneficiaries  who,  after  being  so  identified 
^S6^?  m-home  assessments,  and  (b)  to  select  subsets  of  persons  in' the  FFS 
and  HMO  populations  to  receive  health  choice  interviews.  Persons  found  to  be 

lir^,1f!l,0?!?Stlt^ted  the  ijnPaired  FFS  comparison  group  panel.  Westat,  Inc. 
conducted  these  interviews  from  May  15,  1986  through  January  31,  1987! 

Case-finding  procedures  paralleled  those  used  in  the  1982  National  long 
Term  Care  Survey  (NITC) ,  supported  by  the  U.S.  Health  Care  Financing 
Administration  (HCFA)  and  the  Office  of  the  Assistant  Secretary  for  Planning 
and  Evaluation  (ASPE) :  H 

o        Developing  a  sampling  frame; 

o   Conducting  telephone  screening  survey  (and/or  mail  questionnaire  to  those 
for  whom  phone  number  could  not  be  obtained) ;  and 

o   Conducting  an  in-home  interview  among  those  identified  as  impaired. 

To  construct  the  case-finding  sampling  frame,  Westat  used  a  Medicare 
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Figure  2 
IMPAIRMENT  CLASSIFICATION  CRITERIA 

SEVERE  FUNCTIONAL  IMPAIRMENT 

o   Must  stay  in  bed  all  or  most  of  time;  and/or 

o   Unable  to  perform  one  or  more  activities  of  daily  living 

(ADL)  without  assistance  (e.g. ,  eating  ,  getting  in  or  out  of 
chairs,  toileting,  dressing,  or  bathing) 

MODERATE  FUNCTIONAL  IMPAIRMENT 

(Not  classified  in  severe  group,  but  having  one  or  more 
of  these  conditions.) 

o   Unable  to  perform  three  or  more  instrumental  activities  of 
daily  living  (IADLs)  without  assistance  (e.g.,  prepare 
meals,  do  laundry,  light  housework,  shop  for  groceries, 
manage  money,  take  medicine,  make  telephone  calls) ; 

o   Unable  to  perform  two  or  more  IADLs  without  assistance  and 
having  limitations  in  mobility  (e.g. ,  must  stay  in  the  house 
all  or  most  of  the  time,  or  needs  the  help  of  another  person 
in  getting  around  inside  or  outside  the  house) . 

o   Unable  to  do  at  least  two  of  the  following:  light  house  work, 
shopping  for  groceries,  prepare  meals;  or  unable  to  take 
medications  or  make  telephone  calls  without  assistance; 
or  unable  to  get  around  inside  the  house  without  assistance. 

o    Problems  with  severe  memory  loss;  as  reported  by  a  proxy 
respondent 

o.   Using  a  wheelchair  or  walker; 

o   All  cases  considered  by  the  S/HMO,  as  impaired,  on  a  basis  other  than  the 
health  status  form,  will  also  be  classified  as  moderately  impaired. 
Health  status  assessments  occur  at  the  time  of  enrollment.  This  status 
may  change  over  time  and  not  be  reflected  in  the  HSF  data  set. 
Consequently,  any  other  data  available  within  the  S/HMO  to  reflect  the 
health  status  of  its  members  at  a  given  time  is  also  considered  to  be  an 
appropriate  basis  for  health  status  classification. 

UNIMPAIRED 

o   All  those  not  identified  as  severely  or  moderately  impaired. 
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SSi^S  ^  ****  tape  CQntaini^  the  names,  addresses,  age    gender 

^^be^included  in  the  fee-for-servioe  sampling  frame  the  subject  was 

o        Be  alive  at  the  time  of  the  survey; 
o        Be  age  65  or  older; 

Be  covered  by  both  Part  A  and  B  of  Medicare; 

Not  have  end-stage  renal  disease; 

Not  be  a  member  of  an  HMO  or  S/HMO  as  of  March  1,  1986; 

Not  be  in  a  nursing  home  as  of  the  date  of  interview; 

Not  be  receiving  Medicaid  as  of  March  1,   1986;  and 

Reside  in  the  S/HMO  market  area. 

^™,^<?Ct0beL^986  a  s^ienental  FFS  sample  was  drawn  for  all  four 
communities.     This  was  necessary  because  th£  overall  response  rate 
particular^  among  those  aged  85  and  over,  was  nX^SgTal  Sfbeen 

SSS  ^SSL^  Sf^^fH183  *********  rate  wSs  lower  SS 
MSSS'elSiSl^^^13  6Xpande?  Sainple'  individuals  in  the  original 

the  number  of  moderately/severely  impaired  cases  enroSS  toeS^/So 
Ec^al  experimental  and  comparison  group  sample  sizes  maSnSeTSe  Mistical 

S^SfiS6         f^  "^  **■  constratet  °f  the  maximum  ramfcer  of 
mcderately/severely  impaired  S/HMO  enrollees  available  for  study. 

«iwJ^=HMD1.PCFUlf ^  Within  any  S/HM0  narkEt  area  consisted  of  a  variety  of 

SS^D  c^S?8^  ^  ™Z  V^erS'  ^g^less  of  enrollmerTdtte  or 
type  of  HMO  contract;  HMO  members  who  joined  a  TEEXA  HMO  for  the  first  fc£» 

rSv^S^  the  S/HMO  was  in  operation;  and  pSonf  wJ^Sd  ^ 
recently  converted  from  a  non-risk  contract  HMO  to  a  riskcontract  membership. 

Healt2lJLtSJS2iS?e  HSal?  Insu*anc*  Master  Record  files,  and  the  Group 
S^Se^S  SS^'   ^^tors  identified  all  Medicare  beneficiarieTwho 

"esfa^ona?crite?Lr1US10n  "*  **  a*,aElaon  "*^  f^ '  «* 
o        Enrolled  in  a  Medicare-risk  contract  HMO,  and 
o        Enrolled  between  June  1985  and  March  1,  1986. 


iSSS?'  ^^lonale  underlying  restricting  the  sample  to  this  time 

S^SfecTSrSSe^r636^^  °f  *■  «">«««  fix-  ihich  the  S/BOs 

s/HmF-i!Sl.3  llstsJ,thf  Medicare  risk-sharing  health  plans  cperaticnal  in  the 
S^^"Sr-  >*?to  that  no  such  plans  were  operational  in  Brooklyn,  New  York 

2MLT5SS  £  ssrL«ss  sscs-ssa  !5rS5r 

correspondence  was  miled  on  Hera  letterhead.     terSns^o^soSim  to  the 

receiving  advance  notices  were  Social  Security  Admi^totte,  SSSt 
SSTandieSer  ST^.^  ^^  °f^'  *~  ^  - 

^r^SS^^^S^^^^--^ 
important  in  this  regard  was  the  attempt  to  locate  proxy  resDond^itsin  t-h* 

event  that  sample  members  were  physically  or  men^ly^aSf^S^enSv 
£^S5?V£  a  telephone  interview,     overall,  10.1  percent  o?  STnrerviews 
were  completed  by  proxies,     mis  rate  was  substantial^higher  among^ersons^ 
aged  80  or  over  (i.e. ,  18.6%  for  women  and  31.6%  for  men) .  ^^  Ve**™™ 

During  the  course  of  the  case-finding  telephone  survey,  7.6  percent  of 
sampled  persons  were  found  to  be  ineligible  relative  to  the  selection^ 
criteria.     These  persons  were  deceased,  institutionalized,  or  had  moved  out  of 
the  area      All  subjects  not  definitely  known  to  be  ineligible  were^SmSTto 
be  eligible.     This  almost  certainly  overstates  the  actual  eligS3iS^ate 
since  addresses  were  not  confirmed  for  about  13.9  percent  of  the  eligible 

^fiSTo63'  ACtUal  refusals  totaled  15.1  percent,  and  other  non-responses 
totaled  4.8  percent  of  those  thought  to  be  eligible!  responses 

m  J5  i!!S:-tWi?e  a-Wee1^  Westat  forwarded  the  names  and  contact  informaticn 
for  all  functionally  unpaired  persons  identified  through  case  finding  to 
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Figure  3 

RISK  CONTRACT  HEALTH  PLANS 
IN  S/HMO  MARKET  AREAS,  JUNE  1986 


Portland,  Oregon 

o    Blue  Cross/Blue  Shield  (First  Choice) 
o   Kaiser-Permanente  (Medicare  Plus) 
o    Physicians  Interhospital  Health  Plan 

(The  Good  Health  Package) 
o    PacifiCare  (Secure  Horizons) 

Approximate  Medicare  enrollment:  19,900  beneficiaries 

long  Beach,  California 

o   Family  Health  Plan 

o   Maxicare 

o    PacifiCare  (Secure  Horizons) 

o   United  Health  Plan 

Approximate  Medicare  enrollment:  79,000  beneficiaries 

Minneapolis,  Minnesota 

o   Group  Health 

o    HMO  Minnesota 

o   Medcenters  Health  Plan 

o   Physicians  Health  Plan  of  Minnesota 

o    SHARE 

Approximate  Medicare  enrollment:  85,800  beneficiaries 
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Beri^ey  Planning  Associates  (BPA) .  BPA  had  recruited  a  field  staff  to 
conduct  in-home  comprehensive  assessments  on  functionally  impaired  screened 
respondents  in  each  of  the  demonstration  site  communities.  Table  1  summarizes 
the  survey  results.  ™ 

UNIMPAIRED  S/HMD  AND  FFS  SAMPLE 
HEAUIH  STATUS  DEFORMATION  TRACKING 

Each  S/HMD  demonstration  project  was  required  to  collect  Health  Status 
Information  on  all  enrollees.  The  S/HMDs  collected  this  information  using  a 
mail  self-completion  Health  Status  Form  (HSF)  at  enrollment,  and  at 
approximately  annual  intervals  thereafter.  The  Evaluation  Design  Report  and 
Data  Collection  Plan  contains  the  HSF  and  other  instruments  used  in  primary 
data  collection.  We  adapted  the  S/HMOs  HSF  for  use  at  the  telephone 
case-finding  interview  schedule.  At  annual  intervals  for  two  years  following 
the  baseline  interview  a  shortened  version  of  this  form  is  also  administered 
as  a  self-completion  questionnaire  for  the  unimpaired  fee-for-service 
comparison  group  . 

Periodic  HSF  readministratian  to  unimpaired  S/HMD  and  FFS  beneficiaries 
permits  longitudinal  monitoring  of  sample  beneficiary  functional  health 
status.  Panel  members  with  a  change  in  status  from  unimpaired  to  impaired 
will  be  followed  up  by  Comprehensive  Assessment  tracking  procedures. 

Between  December  1986  and  June  1987,  the  sites  conducted  the  first  annual 
reassessments  of  their  members.  Comparison  group  reassessments  were  conducted 
during  Summer  and  Fall  1987.  Persons  not  responding  to  these  mail 
questionnaires  will  be  interviewed  by  telephone.  All  unimpaired  S/HMD  and  FFS 
comparison  group  members  are  being  monitored. 

Berkeley  Planning  Associates  (BPA)  and  the  Institute  for  Health  &  Aging 
(IHA)  share  responsibility  for  HSF  tracking.  IHA  is  responsible  for 
distributing  and  coding  the  mail  questionnaires  and  telephone  contacts  with 
non-respondents  in  the  unimpaired  subsample.  Cases  reporting  declines  in 
health  status  are  referred  to  the  BPA  on-site  field  teams  for  comprehensive 
assessments.  -  BPA  conducts  comprehensive  assessments  on  S/HMD  unimpaired 
enrollees  whose  annual  reassessments  indicate  a  negative  change  in  health 
status  (i.e.,  subjects  who  now  meet  the  study's  moderately  and/or  severely 
impaired  classification  criteria) . 

COMPREHENSIVE  ASSESSMENT  AND  PERIODIC 
S/HMD  AND  FFS  IMPAIRED  GROUP  TRACKING" 

The  Comprehensive  Assessment  Form  (CAF)  is  the  primary  instrument  for 
gathering  health,  functional  status,  and  informal  support  data  from  the 
functionally  impaired  S/HMD  and  FFS  groups.  This  instrument  also  includes 
information  on  service  utilization  and  costs  not  available  on  Medicare  data 
tapes  (i.e. ,  use  and  expenditures  for  services  included  in  S/HMD  chronic  care 
benefits) .  The  CAF  form  was  originally  developed  by  the  S/HMD  sites  and 
Brandeis  University  and  has  been  only  slightly  modified  by  the  evaluation 
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Table  1 

UNWEIGHTED  COUNT  OF  IMPAIRED  AND  NON-IMPAIRED  PERSONS 
IN  THE  S/HMO,  HMO,  AND  FFS  SAMPLES 


Unlocatable/ 
Un-  other  Total 


Brooklyn 

>   ivsnirmxa 

v-ranpietea 

S/HMO 

FFS 

HMD 

2667 

3408 

NA 

2389 

1290 

NA 

278 
343 

NA 

NA 

211 

NA 

NA 
1002 

NA 
562 

2667 
1633 

Long  Beach 

•  ■ 

3/HMO 

FFS 
iMO 

1826 
3555 
1000 

1472 

1810 

584 

354 
316 
109 

NA 

185 

43 

NA 
777 
155 

NA 
467 
109 

1826 

2126 

693 

Minneapolis 

5/HMO 

1671 
2935 
1000 

1409 

1332 

639 

262 

288 

72 

NA 

444 

54 

NA 

482 

66 

NA 
389 
169 

1671 

1620 

711 

Portland 

J/HMO 

TS 

iMO 

4517 
6760 
1000 

3608 

3795 

716 

909 

637 

75 

366 

527 

39 

NA 

836 

83 

NA 

963 

87 

4517 

4434 

791 

kjurce: 


Classifications  are  based  on  telephone  or  mail  questionnaire  Health  Status  Form 
assessments.  These  figures  are  subject  to  change  as  in-home  comprehensive 
assessments  are  completed  and  tabulated. 
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team. 


A  comprehensive  assessment  form  (CAF)  is  administered  to  q/Hvn  ^v^ 
under  a  variety  of  circumstances:  acmunistered  to  S/HMO  members 

o   Most  conmonly,  at  the  time  of  enrollment  into  the  health  olan  if  the 

STATIST  KS&firi.1*  ^^  *~^££*£±* 

(e.g.,  NHC)  or  other  eligibility  criteria  for  chronic  care  benefits;  or 
°        ^S^?Srwenr0lllnfnt  because  of  chan9es  *»  health  status  of  individuals 

°        S™^  SanP^e  ?einb^r  ^  at  time  of  enrollment  or  any  later  time 
severf  (TT^L^^  aocordin?  to  the  evaluation^cri^iTol 
rK^W^£^£^.°2  ^°rc  m  stations)  will  receive 
Staff  ^h^  C^  ^1  ^  conducted  by  S/HMD  case  management 


o        Any  S/HMD  sample  member  who,  at  baseline  or  subsequently    meets  the 

evaluation's  moderate  impairment  classificatio^Smllso^ecJive^  a  cav 
These  CAFs  will  be  conducted  by  BPA  nurse  assessors/ 

o  Automatic  reCAFs  at  six-month  intervals  will  be  conducted  with  anv  S/HMD 
sample  member  1)  classified  as  nursing  heme  oa^JO^i^^SS^ 
common  cross-site  NHC  criteria  for  this  classification?  ori     recSSna 

S^S^f6-^063'     13aia  protoco1  *****  s/™>  ^  Sacking  ^ 
procedures  with  those  used  for  the  comparison  group.  ^^ 

o  All  moderately  impaired  (based  on  the  evaluator's  criteria)  s/ram  «-i0 
members  will  be  monitored  annually  by  mail  quStionSS    *     ^  ^ 

°        ^*2Sed  °S  5"  ^^tor'5  criteria,  the  beneficiary  changes  health 

f^SL  ZJ?°Vlng  fran  ""^^^te  to  severe,  or  severe  to  NHC  -  then  a  CAF 
^conducted.     For  severe  cases,  CAFs  will  be  conducted  by  S/HMD^Sse" 
managers.     For  moderates,  BPA  will  administer  the  CAF. 

^r^L^S?^^6  assessment  process  used  with  the  FFS  comparison  group 
^S^iffi*6  P^633  f?llc^d  by  the  S/HMO  sites.     To  coSe^CAF  dlta^ 
S?L2f  f^1?1^1^  unpaired  fee-for-service  sample,  BPA  recruited  nurses 
and  medical  social  workers  in  each  S/HMO  marketlSL     Workir^der  BPA^ 
supervision,  these  nurses  and  social  workers  administered  the  CAF  at  baseline 
andat  appropriate  reassessment  intervals.     They  were  responsible  for  all 
direct  personal  contact  with  respondents. 
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For  comparison  group  assessments: 

«  ouc-or  pocket  expenditures  occurring  during  the  month. 
°   SS^V?*1™*  ^sP^ents  had  their  health  status  use  and 

CONSUMER  CHOICE  AND  SATISFACTION 

anuary  31,  1987.  This  survey  involved  samples  from  three  pc^pulationsT 
«    l^!^}66?  (both  ^^  and  unimpaired) 


Table 
rates. 
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Table  2 

NUMBER  OF  BASELINE  COMPREHENSIVE  ASSESSMENTS 
COMPLETED  THROUGH  JANUARY  31,  1987 


Baseline   Qualified 
CAF     Lnpaired 


Brooklyn 

S/HMO 
FFS 

Long  Beach 

S/HMO 
FFS 

Minneapolis 

S/HMO 
FFS 

Portland 

S/HMO 

FFS 


156 

117 

282 

165 

341 

193 

267 

179 

269 

168 

245 

167 

829 

422 

617 

382 

-13- 


Table  3 

UNWEIGHTED  COUNT 
HEAITH  CHOICE  SAMPLE  CASES 


Sample 

Impaired 
Completes 

Unimpaired 
Completes 

Unimpaired 
Incompletes 

Impairer! 
Incompl  .Ut 

Brooklyn 

S/HMO 

FFS 

356 
533 

202 
179 

102 
320 

31 
18 

"1 
16 

long  Beach 

S/HMO 

FFS 
HMO 

460 
542 
345 

203 
201 

215 

107 
289 
103 

37 
28 
21 

63 
24 

6 

Minneapolis 

S/HMO 

FFS 

HMO 

382 
504 
320 

213 
201 
238 

96 

277 

71 

48 
20 
10 

25 
6 

1 

Portland 

S/HMO 

FFS 

HMO 

451 
472 
350 

201 
204 
256 

179 
229 

74 

34 

15 
19 

:\ 

Impairment  classifications  are  based  on  telephone  or  mail  questionnaire  Health 
Status  Form  assessments. 
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of  unpaired  and  unimpaired  subgroups  in  each  community.  Approximately  equal 
sample  sizes  across  S/HMD,  FES,  and  HMD  subgroups  maximized  the  efficiency  of 
the  impaired  sample  within  the  evaluation's  existing  budget.  Impaired  cases 
numbered  more  than  the  unimpaired  cases  because  the  impaired  cases  had  not  yet 
been  corrected  by  field  verifications  of  impairment  levels. 

Current  plans  are  to  recontact  the  consumer  choice  sample  in  the  summer 
of  1988  for  questions  about  their  health  plan  satisfaction.  This  effort  was 
augmented  with  a  mail  survey  of  persons  disenrolling  from  the  S/HMDs  and  TEFRA 
HMD  competitors  during  the  summer  of  1986.  Approximately  2,950  enrollees  in 
the  4  S/HMD  market  areas  were  contacted. 

The  satisfaction  survey  of  S/HMD,  FFS,  and  HMD  members  is  planned  as  a 
self-completion,  mail  questionnaire.  Its  date  of  administration  has  been 
shifted  from  summer  1987  to  1988.  This  survey  has  been  postponed  to  minimize 
the  burden  on  the  evaluation  study  panels  —  especially  the  impaired  sample. 

During  spring  1987,  the  evaluator  conducted  a  mail  survey  of  Medicare 
beneficiaries  who  disenrolled  from  the  S/HMDs  during  the  period  June  1986  to 
November  1986  and  disenrollees  from  TEFRA  HMD  competitors  during  the  same 
period*  A11  Persons  identified  in  Medicare  records  as  having  disenrolled  from 
selected  TEFRA  HMDs  in  the  S/HMD  market  arena  during  this  interval  were  sent  a 
mail  questianaire  in  February  1987.  A  follow-up  mailing  to  non-respondents 
was  conducted  in  June  1987.  Toe  rate  of  return  to  the  disenrollment  survey 
has  been  disappointing  and  a  final  response  rate  has  not  been  determined. 
Analysis  is  complicated  by  the  fact  that  some  of  the  identified  subjects 
claimed  not  to  have  disenrolled  from  an  HMD.  A  review  of  returned 
questionnaires  reveals  some  expected  reasons  for  disenrollment  (e.g. ,  moving 
to  another  area,  inconvenient  locations  of  clinics,  dissatisfaction  with 
availability  of  physicians  or  specialists)  and  some  unexpected  reasons  (e.g. 
respondents  did  not  intend  to  enroll  in  the  first  place) . 

SERVICE  UTILIZATKDN  AND  EXFENDITURES 

The  evaluator  collects  out-of-plan  and  non-Medicare  Part  A  and  B  service 
use  and  expenditure  data  for  all  impaired  persons  in  the  S/HMD  enrollee  sample 
and  for  all  impaired  persons  in  the  FFS  comparison  group  sample.  These  data 
supplement  Medicare  Part  A  and  Part  B  service  use  histories  of  both 
fee-for-service  and  S/HMD  evaluation  samples.  All  chronic  care  service 
utilization  and  expenditures  and  selected  non-Medicare  services  (e.g.,  home 
care,  social  services)  are  being  studied  for  the  functionally  impaired  S/HMD 
and  fee-for-service  comparison  groups.  Hospital  and  physician  utilization  and 
expenditures  are  obtained  from  Medicare  claims  files  and  S/HMD  claims  records 
(see  discussion  below  on  secondary  data  collection) . 

The  out-of-plan  and  out-of-pocket  expenditure  data  was  collected  by  means 
of  a  service  use  diary  maintained  by  respondent.  This  diary  used  a  calendar 
to  stimulate  memory,  and  a  record  keeping  ledger  to  summarize  use  and 
expenditures.  BRA  staff  distribute  these  diaries  during  their  in-home  visits 
and  explain  to  impaired  sample  members  and/or  their  caregivers  at  the  time  of 
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their  first  comprehensive  assessment  how  to  use  the  diary.  BPA  staff  also 
contacted  S/HMO  enrollees  who  had  previously  received  a  CAF,  and  showed  them 
how  to  keep  the  diary.  Among  the  FES  groups,  compliance  is  monitored  throuqh 
the  following  means:  v 

o        Sample  members  who  are  severely  impaired  and  who  are  nursing  home 
certifiable  (NHC)  receive  monthly  telephone  monitoring  calls  and 
semiannual  personal  visits. 

o   Moderately  impaired  persons  and  the  non-NHC  severely  impaired  receive 
quarterly  mail  questionnaires  asking  them  to  summarize  service  use 
activity  during  the  previous  three  months. 

o    Persons  who  do  not  return  questionnaires,  or  whose  answers  are  incomplete 
or  at  variance  with  previous  reporting  periods  receive  a  telephone  call 
to  clarify  and  complete  the  form. 

o    Persons  in  the  FFS  sample  who  experience  an  adverse  change  in  health 
status  also  receive  a  personal  visit  and  are  given  a  CAF.  During  such 
visits  the  service  utilization  and  expenditure  tracking  materials  are 
also  reviewed. 

Among  the  S/HMO  members  who  were  moderately/severely  impaired,  compliance 
is  monitored  through  the  following  means: 

o   The  severely  impaired  are  reviewed  and  evaluated  by  the  S/HMD  case 

managers  every  six  months.  Service  use  in  conjunction  with  the  care  plan 
is  routinely  monitored  on  the  patient's  case  record.  A  service  does  not 
have  to  be  covered  or  paid  for  by  the  S/HMO  to  be  included  in  this  care 
plan. 

o   Moderately  impaired  individuals  and  other  impaired  S/HMO  members  not 

receiving  S/HMD  benefits  receive  quarterly  mail  questionnaires  from  IHA. 
Those  persons  who  do  not  return  the  mail  questionnaires,  or  whose  answers 
are  incomplete,  receive  a  follow-up  telephone  call  from  BPA  nurse 
assessors  to  collect  data  by  phone. 

Figure  4  lists  the  services  being  tracked  or  monitored  through  these 
procedures. 

SECONDARY  DATA  COLLECTION 

Two  sources  of  secondary  data  are  being  used  for  analyses  of  selection 
bias  and  expenditures  and  service  use:  Medicare  Beneficiary  Bill  History 
Retrieval  System  data  for  Medicare  Part  A  and  Part  B  service  utilization  and 
charges,  and  the  S/HMO  management  information  systems.  These  data  sources 
produce  complete  and  integrated  health  care  utilization  and  expenditure 
records  on  all  study  sample  subjects.  They  form  the  nucleus  of  the  case 
specific  record,  into  which  the  study's  primary  data  are  merged.  These  same 
data  sources  are  also  being  used  to  create  a  data  file  on  all  Medicare 
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Figure  4 


CHRONIC  CARE  UTILIZATION  AND  EXPENDITURE  MONITORING  CATEGORIES 


HOME  HEALTH  CARE  SERVICES 
Visiting  Nurse 
Physical  Therapist 
Social  Worker 

Other  Services 

j. 

OTHER  COMMUNITY  SERVICES 
Adult  Day  Health  Care  Center 
Social  Day  Care  Center 
Hamemaker,  Housekeeper,  or 

Chore  Service 
Other  Services 


Occupational  Therapist 
Respiratory  Therapist 
Home  Health  Aide 
Speech  Pathologist 


Home  Delivered  Meals 
Electronic  Monitoring 
(Lifeline) 


DENTAL  SERVICES 

Dentist 

Dental  hygienist 

Orthodontist 

Other  services 


Oral  surgeon 
Periodontist 


TRANSPORTATION  SERVICES 
Ambulance 

Transportation  to  health  services  (including  taxi,  minibus, 
escort  services,  and  taxi  vouchers) 


EQUIPMENT  AND  SUPPLIES 
Eyeglass  or  Contact  Lenses 
Crutches,  Wheelchair,  Walker 

Corrective  Shoes,  or  other 

Orthopedic  Device 
Hearing  Aid 

Diabetic  Equipment  or  Supplies 
Medical  Alert  Device  or 

Electronic  Monitoring  Device 
Other  Device  or  Equipment 

PRESCRIPTION  DRUGS  AND  MEDICATIONS 

NURSING  HOMES  AND  BOARD  AND  CARE  HOMES 
Skilled  Nursing  Care  (in  a  hospital  or  nursing  home) 
Intermediate  Care  (in  a  hospital  or  nursing  heme) 
Board  and  Care  (including  residential  care,  domiciliary  care, 
family  heme,  etc. ) 


Respiratory  devices 
Prosthesis  (artificial  arm, 

leg  or  breast) 
(Seeing-Eye  or  Hearing-Ear 

Dog) 
Modifications  to  your  home 

(ramps,  elevator,  hand 

rails,  raised  toilet  seat, 

etc.) 
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beneficiaries  living  within  each  of  the  S/HMD  market  areas. 

Medicare  Part  A  includes  hospital,  home  health  care,  and  skilled  nursing 
home  claims.  Physician  and  home  health  care  are  among  the  billing  claims  paid 
under  Medicaid  Part  B.  Part  A  and  Part  B  claims  data  have  been  obtained  for 
all  S/HMD  enrollees  and  FFS  and  HMO  comparison  group  clients  for  at  least  one 
year  prior  to  the  date  the  client  entered  the  S/HMO  or  entered  the  study  as  a 
comparison  group  participant. 

Data  will  continue  to  be  collected  for  each  S/HMO  or  FFS  beneficiary  an 
additional  24  months  (the  elapsed  time  may  be  closer  to  30  months  due  to  the 
lag  time  between  service  receipt  and  the  claim  on  the  billing  tape)  or  until 
the  beneficiary's  death.  Medicare  data  will  also  continue  to  be  obtained  on 
all  S/HMO  disenrollees  for  that  portion  of  the  study  period  during  which  they 
are  disenrolled. 

S/HMO  Utilization  and  Expenditure  Client  Files  are  being  developed  by 
each  of  the  S/HMO  demonstration  programs.  These  files  contain  information  on 
the  use  of  ambulatory  care,  hospitals,  all  chronic  care  benefits,  and  any 
vendor  charges.  These  systems  vary  in  current  operational  status  and 
integration  across  records  systems.  For  purposes  of  the  evaluation,  the 
S/HMOs  and  the  evaluators  are  closely  collaborating  in  the  development  of  a 
uniform,  beneficiary-specific  data  base  from  these  files.  By  December  1987, 
it  is  anticipated  that  all  S/HMO  site  will  have  the  ability  to  provide  the 
evaluator  beneficiary-specific  computerized  files. 

Primary  and  secondary  data  sets  will  be  appropriately  merged  into  an 
integrated  file  for  each  individual  in  the  evaluation  study  sample.  For  S/HMD 
unimpaired  enrollees,  only  S/HMO  use  and  billing  records  and  HSF  data  are 
merged.  S/HMD  impaired  enrollee  records  include  these  same  data  and  the 
primary  data  collected  on  non-plan  expenditures. 

Among  the  FFS  unimpaired  comparison  group  sample,  Medicare  Part  A  and  B 
claims  are  used  to  to  measure  service  use.  These  data  are  combined  with  HSF 
data.  Impaired  FFS  files  combine  HSF  and  CAF  data  with  Part  A  and  B  claims 
data  and  data  on  chronic  care  and  other  non-Medicare  services  collected  from 
service  use  diaries. 

THE  S/HMO:  AN  EVOLVING  ORGANIZATIONAL  FORM 

Recognizing  that  the  S/HMOs  operate  in  a  changing,  competitive 
environment,  the  Health  Care  Financing  Administration  commissioned  case 
studies  of  the  S/HMOs  to  complement  the  program  performance  data  discussed 
above.  These  studies  document  the  evolving  forms  and  functions  of  the  S/HMD 
model  and  provide  a  primarily  qualitative  analysis  of  program  performance. 
Three  case  studies  have  been  developed.  Their  findings  —  encompassing  the 
first  24  to  30  months  of  S/HMD  operations  —  are  included  as  Chapters  2,  3, 
and  6  in  this  report.  These  studies  will  later  be  updated  and  elaborated  to 
cover  the  remainder  of  the  S/HMD  demonstration. 
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The  case  studies  address  three  issues:  (1)  the  market  environment  and 
S/HMO  marketing  effectiveness;  (2)  the  effectiveness  of  different  S/HMO 
organizational,  management,  and  financing  strategies;  and  (3)  the 
effectiveness  of  S/HMD  case  management  systems. 

MARKET  ANALYSIS 

The  market  analysis  examines  S/HMO  competition  within  each  marketplace 
and  the  effectiveness  of  the  S/HMOs  in  meeting  projected  enrollment.  The 
analysis  is  based  on  data  from  unaudited  quarterly  reports  submitted  by  the 
sites  to  HCEA  and  on  qualitative  data  from  site  visit  interviews  with  program 
officials  and  other  local  informants.  The  case  study  addresses  such  questions 
as:  (l)  what  were  the  enrollment  patterns  of  each  of  the  S/HMOs;  (2)  what 
were  the  Medicare  enrollment  patterns  of  competing  HMOs,  PPOs,  and  insurers  in 
each  area;  (3)  what  were  the  characteristics  of  competing  plans  in  operation, 
sponsorship,  benefits,  premiums,  and  service  delivery;  (4)  what  marketing 
efforts  have  been  made  by  competition  and  by  the  S/HMOs  and  how  do  these 
relate  to  actual  enrollment  trends;  (5)  how  did  competition  affect  the 
enrollment  patterns  of  the  S/HMOs;  (6)  what  other  market  factors  (i.e., 
physician  and  hospital  bed  supply)  affected  S/HMO  marketing 
effectiveness;  (7)  did  the  reputation  and  the  attitudes  of  the  S/HMOs  or  their 
participating  providers  affect  marketing;  and  (8)  considering  all  these 
factors,  how  effective  has  each  S/HMO  been  in  marketing  its  plan  to  the 
elderly? 

ORGANIZATION,  MANAGEMENT,  AND  FINANCING 

This  analysis  examines  the  organizational  structure,  goals,  management, 
and  financing,  of  the  four  S/HMOs.  This  study  of  the  S/HMOs  as  evolving 
organizations  is  conducted  at  six-month  intervals  over  a  two-year  time  period 
beginning  in  the  Fall  of  1986.  Data  used  include  interviews,  plan  documents, 
and  other  secondary  data  sources.  Among  those  interviewed  are  officials 
formally  associated  with  each  of  the  S/HMOs,  all  managers,  key  professional 
staff  including  the  medical  director,  utilization  review  coordinator, 
membership  services  director,  fiscal  administrator,  marketing  and  public 
relations  director,  and  case  manager  ocordinator.  Directors  of  all  major 
provider  services  (e.g. ,  hospital  administrator,  medical  director,  and 
directors  of  chronic  care  providers) ,  and  selected  board  members  from  the 
S/HMO  board,  as  well  as  the  board  of  the  sponsoring  organization,  are  also 
interviewed. 

Documents  and  reports  reviewed  include:  articles  of  incorporation, 
organizational  charts,  protocols,  contracts,  written  procedures  manuals, 
applications  to  federal  and  state  agencies,  statistical  and  financial  reports, 
quarterly  reports,  actuarial  analyses,  position  papers,  in-house  memoranda, 
newspaper  articles,  and  pertinent  correspondence  with  federal  and  state 
agencies. 

The  case  study  identifies  characteristics  and  strategies  that  influence 
the  success  of  the  S/HMO  as  a  health  care  organization.  Success  is  measured 
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by  accomplishing  the  goals  set  for  the  program: 

o   Attracting  enrollees  and  meeting  a  minimum  target  enrollment; 

o   Preventing  adverse  selection; 

o   Controlling  hospital  and  physician  utilization  within  limits  typical  of 

other  HMDs; 
o   Controlling  chronic  care  utilization  within  the  projected  level  in  the 

S/HMO  budget; 
o   Maintaining  low  disenrollment  rates  and  high  consumer  satisfaction; 
o    Providing  high  quality  of  care; 

o   Assuring  access  to  appropriate  care  services  for  all  in  need;  and 
o   Maintaining  organizational  costs  within  projected  budget. 

CASE  MANAGEMENT 

The  S/HMO  case  management  system  was  designed  to  reduce  fragmentation  in 
service  delivery  and  to  integrate  acute  care  and  long  term  care  services.  The 
S/HMO  case  managers  assess  enrollee  functional  status,  develop  individualized 
care  plans,  serve  as  client  advocates,  coordinate  services,  and  monitor 
service  use.  These  functions  place  the  case  manager  in  the  role  of  resource 
allocator.  Since  expenditures  for  the  expanded  long  term  care  benefit  were 
constrained,  S/HMO  case  managers  must  target  these  resources  in  the  most 
cost-effective  manner  so  as  to  produce  acceptable  clinical  outcomes  for 
enrollees.  The  process  by  which  the  S/HMO  case  managers  translate  enrollee 
needs  into  services  is  a  critical  element  in  the  S/HMO  delivery  model. 

The  evaluation  of  S/HMO  case  management  has  three  parts:  a  case 
management  process  evaluation;  a  case  management  task  analysis;  and  a  case 
management  outcome  evaluation. 

To  begin  the  case  management  process  evaluation,  BRA  staff  interviewed 
case  management  staff  and  reviewed  program  records.  BRA  will  update  this 
information  in  spring  1988  and  will  augment  these  efforts  through  a 
participant  observation  to  document  case  management  activities.  These 
observations  should  provide  valuable  insights  into  each  site's  case  management 
philosophy  and  procedures.  Special  emphasis  will  be  placed  on  understanding 
case  management  decision-making  and  resource  allocation,  and  on  answering 
these  questions:  (1)  Who  in  the  S/HMO  receives  case  management  services;  (2) 
How  are  S/HMO  enrollee  chronic  service  needs  met?  and  (3)  What  are  the  costs 
of  case  management? 

BRA  will  also  quantify  case  management  functions  at  each  site  through  a 
time  study.  All  case  managers  and  supervisory  staff  will  participate  in  the 
study  of  the  time  it  takes  to  perform  different  case  management  activities. 
This  study  will  be  conducted  over  a  two-week  period  at  each  site  in  spring 
1988.  Case  management  outcomes  are  addressed  in  relationship  to  the  analysis 
of  S/HMO  impacts  on  chronic  care  service  utilization  and  costs. 
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